Measuring and Modifying the Intrinsic Memorability of Images
نویسندگان
چکیده
Images have intrinsic memorable properties that enable humans to recall them. In this thesis, I developed and carried out a procedure to measure the memorability of an image by running hundreds of human-trials and making use of a custom designed image dataset, the Mem60k dataset. The large store of ground-truth memorability data enabled a variety of insights and applications. The data revealed information about what qualities (emotional content, aesthetic appeal, etc.) in an image make it memorable. Convolutional neural networks (CNNs) trained on the data could predict an image's relative memorability with high accuracy. CNNs could also generate memorability heat maps which pinpoint which parts of an image are memorable. Finally, with additional usage of a massive image database, I designed a pipeline that could modify the intrinsic memorability of an image. The performance of each application was tested and measured by running further human trials. Thesis Supervisor: Antonio Torralba Title: Associate Professor
منابع مشابه
The intrinsic memorability of face photographs.
The faces we encounter throughout our lives make different impressions on us: Some are remembered at first glance, while others are forgotten. Previous work has found that the distinctiveness of a face influences its memorability--the degree to which face images are remembered or forgotten. Here, we generalize the concept of face memorability in a large-scale memory study. First, we find that m...
متن کاملComputational Understanding of Image Memorability
Previous studies have identified that images carry the attribute of memorability, a predictive value of whether a novel image will be later remembered or forgotten. In this thesis we investigate the interplay between intrinsic and extrinsic factors that affect image memorability. First, we find that intrinsic differences in memorability exist at a finer-grained scale than previously documented....
متن کاملIntrinsic and extrinsic effects on image memorability
Previous studies have identified that images carry the attribute of memorability, a predictive value of whether a novel image will be later remembered or forgotten. Here we investigate the interplay between intrinsic and extrinsic factors that affect image memorability. First, we find that intrinsic differences in memorability exist at a finer-grained scale than previously documented. Second, w...
متن کاملUnderstanding the Intrinsic Memorability of Images
Artists, advertisers, and photographers are routinely presented with the task of creating an image that a viewer will remember. While it may seem like image memorability is purely subjective, recent work shows that it is not an inexplicable phenomenon: variation in memorability of images is consistent across subjects, suggesting that some images are intrinsically more memorable than others, ind...
متن کاملMemorability of Image Regions
While long term human visual memory can store a remarkable amount of visual information, it tends to degrade over time. Recent works have shown that image memorability is an intrinsic property of an image that can be reliably estimated using state-of-the-art image features and machine learning algorithms. However, the class of features and image information that is forgotten has not been explor...
متن کامل